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Abstract 

Fermion mass spectra and flavor mixings are studied in detail in the SU{()) x 
SU{2)ji model, in which state-mixings beyond the MSSM take place. Characteristic 
Cl^ patterns of fermion spectra is attributed to the hierarchical structure of effective 

pH I Yukawa interactions via the Froggatt-Nielsen mechanism and also to the state- 

mixings beyond the MSSM. It is found that the neutrino mass matrix in the mass 
, diagonal basis for charged leptons has no hierarchical structure. This is due to 

Cf^ . the cancellation among the hierarchical factors by the seesaw mechanism with the 

I hierarchical Majorana mass matrix of R-handed neutrinos. As a consequence, T^ns 

I exhibits large mixing. It is shown that a simple setting of parameters in the present 

! model is consistent with all observed values of fermion masses and mixings. 

(N 



X: 

--■ 1 Introduction 

Understanding the characteristic structure of fermion masses and flavor mixings is one of 
the major outstanding problems in particle physics. Up-type quarks, down-type quarks, 
charged leptons and neutrinos have distinct hierarchical mass patterns from each other. 
Moreover, the observed flavor mixing is small for quarks but large for leptons. This sit- 
uation is in sharp contrast to a naive expectation from quark-lepton unification. We 
can disentangle ourselves from this discordance by considering the state-mixings between 
quarks (leptons) and extra particles beyond the minimal supersymmetric standard model 
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(MSSM). In fact, it was shown in the context of SU{6) x SU{2)ji string- inspired model, 
which contains massless particles beyond the MSSM, that we are able to explain charac- 
teristic patterns of the observed mass spectra and mixing matrices of quarks and leptons 
[1, 2, 3, 4, 5]. In the model the Proggatt-Nielsen (F-N) mechanism [6] plays an important 
role. In Ref.[5] it was predicted that the absolute value of (1, 3) element of the MNS 
matrix [7] \Ue3\ — | sin ^13] hes between A and A^, where A = 0.23. Recently, new data 
on neutrino mixings become available [8]. The observed value of mixing angle | sin ^13] 
turned out to be ~ A^'^, which supports this prediction. 

In this paper we carry out more detailed study of fermion mass hierarchies and flavor 
mixings in the SU{6) x SU{2)ji string-inspired model. The hierarchical structure due 
to the F-N mechanism comes out not only in the effective Yukawa couplings but also in 
the R-handed neutrino Majorana mass matrix. In the neutrino sector, where the seesaw 
mechanism [9] is at work, the hierarchical factors (the F-N factors) in the Dirac mass 
matrix are faced with the inverse of those in the Majorana mass matrix. This situation 
in the neutrino sector brings about a significant feature peculiar to the MNS matrix, on 
which main emphasis is placed in this paper. As will be shown later, the neutrino mass 
matrix takes the form 

M,<xA^SA^ (1) 
in the mass diagonal basis for charged leptons with 

A^ = diag(Ki, K2, 1), (2) 
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where the parameters Hi {i = 1, 2) and (7j (i = 1, 3, 4) are 0{1). The above form of 
A4u is derived as a consequence of the fact that the F-N factors appearing in the charged 
lepton masses cancel out in large part through the seesaw mechanism. The matrix N in 
Eq.(3), in which the F-N factors are ehminated from R-handed neutrino Majorana mass 
matrix, has no hierarchical structure and det = 1. 

As an example of parameter choice, taking a simple case that N — A,^ — 1 and putting 
(Ti — — 2.2 and (73 = 1.2, we obtain a large mixing solution of the MNS matrix 



/ 0.865 0.471 0.172 
Vmns^ -0.455 0.594 0.663 
^ 0.211 -0.652 0.728 
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for the normal hierarchy. All elements of \4ins offered here are accommodated to the 
present experimental data [10] within 20% provided that 5cp — 0. In addition, eigenvalues 
of E lead to 



which also coincides with the observed value. It is also found that a simple choice of the 
parameter values is consistent with all observed values of fermion masses and mixings. 

This paper is organized as follows. In section 2 we briefly review the SU{6) x SU{2)ji 
string-inspired model together with the F-N mechanism. Taking the mass matrix of up- 
type quarks as an example, we illustrate the whole scheme of the present model. For 
comparison with the case of the lepton sector, we study the mass matrix of down- type 
quarks in section 3. State-mixings occur between down-type quarks and colored Higgsinos 
with even R-parity. We give the exphcit form of the CKM matrix, which proves to exhibit 
small mixing. Similarly to the case of down-type quarks, state-mixings take place between 
leptons and SU(2)L-douh\et Higgsinos. The mass matrix in the charged lepton sector is 
studied in section 4. Section 5 deals with the neutrino sector in which state-mixings 
enter into the seesaw mechanism. The present approach provides a phenomenological 
framework which enable us to analyze many experimental data. Numerical analysis of the 
MNS matrix and fermion spectra is given in section 6. Section 7 is devoted to summary. 

2 Model and Froggatt— Nielsen mechanism 

In this study we choose SU (6) x SU as a unification gauge symmetry at the underlying 
string scale Ms, which can be derived from the perturbative heterotic superstring theory 
via the fiux breaking [1]. In terms of Eq we set matter superfields which consist of three 
families and one vector- like multiplet, i.e.. 



The superfields $ are decomposed into two multiplets of G = SU{6) x SU{2)ii as 



where g'^ and if^. Ha represent colored Higgs and 5'C/(2)L-doublet Higgs superfields, re- 
spectively. Doublet Higgs and color-triplet Higgs fields belong to different representations 




3 X 27($i,2,3) + (27($o) + 27($)). 



(4) 




{Q,L,g,g-,S}, 

{iU'^,D'^),{N^,E-),{H,,H,)}, 



(5) 
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of G and this situation is favorable to solve the triplet-doublet splitting problem. The 
superfields N'^ and S are R-handed neutrinos and S'O(10)-singlets, respectively. Although 

and g'^ as well as L and have the same quantum numbers under the standard model 
gauge group G^m — SU{?>)cX SU{2)l x U{1)y, they belong to different irreducible repre- 
sentations of G. We assign odd R-parity to the superfields $1,2,3 and even to $0 and 
respectively. Since ordinary Higgs doublets have even R-parity, they are contained in $o- 
It is assumed that R-parity remains unbroken down to the electroweak scale. 

The gauge symmetry G is spontaneously broken in two steps at the scales (So) — (S) 
and {N^) = (W) as 

G = SU{6) X SU{2)n H SU{A)ps x SU{2)l x SU{2)r ^ Gsm, (6) 

where SU{4:)ps represents the Pati-Salam 5*^7(4) [11]. Hereafter it is supposed that the 
symmetry breaking scales are (Sq) = 10^^~^^GeV and (Nq) — 10^^~-'^^GeV. We have two 
types of gauge invariant trilinear couplings 

(0(15,1))=^ = QQg + Qg'^L + g'gS, 
(/)(15,1)(V'(6,2))2 = QHdD' + QH^W + LHaE" + LH^N'' (7) 

+SH^Hd + gN^D" + gE^U" + g^VD" 

in the superpotential W. 

Prom the viewpoint of the string unification theory, it is probable that the hierarchical 
structure of Yukawa couplings is attributed to some kind of flavor symmetries at the string 
scale Ms- If the flavor symmetry contains Abehan groups, the F-N mechanism works for 
the interactions among quarks, leptons and Higgs fields [6]. Accordingly, effective Yukawa 
interactions arise from non-renormalizable terms which respect the flavor symmetry. 

Here we consider the effective Yukawa interactions for up-type quarks given by 

3 

Wu = MijQiU^H^o, (8) 

where the subscripts i and j are the generation indices [1]. Due to the F-N mechanism, 
the matrix A4 takes the form 

M^fMr,Mr2. (9) 

Our basic assumption is that the hierarchical structure of all 3 x 3 mass matrices is 
attributed to the F-N factors Fi and/or i^2- Hence, hierarchy of Ai stems only from Fi 
and F2, and M contains no hierarchical structure. Here we put a factor /m in order to 
set det M — 1. The F-N factors Fi and F2 are described as 

ri=diag(x"S x""', 1), r2 = diag(x^\ 1), (10) 
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where x is given by 



and {SqS) is a G-invariant with a nonzero flavor charge. The exponents ai, q;2, /32 
in the F-N factors are determined by assigning flavor charges to the matter fields. Even 
if X by itself is not a very small number, physical parameters can be very small if they 
depend on high powers of x. We assume the hierarchical patterns 



X' 



< < 1, x^^ < < 1 



(11) 



by suitably chosen flavor charges. In this paper we ignore the phase factors of vacuum 
expectation values (VEV's). 

The mass matrix }A is diagonalized via bi-unitary transformation as 



V^^MUu^Au, VuoA-u ^ dieig{mu, rric, mt) 
with Vuo = {Huq). Up- type quark masses are given by 



(12) 



(m„, rric, rrit) ~ Vuo Jm x 



mil 



X 



(13) 



where niij = {M)ij and m,y = A{M)*j [1, 2, 3]. Z\(M)j/s arc the cofactors of M. 
Diagonalization matrix is described in terms of column vectors tu^"'' {i = 1, 2, 3) as 

V„ = wt\ (14) 

where iOj-"^'s are eigenvectors of AIAI^ and expressed as 
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and 



1 + 



[u) 



"1/2 



= 2, 3). 



3 The CKM matrix 

For comparison with the case of the lepton sector, we study the mass matrix of down-type 
quarks in this section. At energies below the scale (N^) there appear mixings between 
D'^ and g'^ which are 5'C/(2)i-singlets.* Effective Yukawa interactions among down-type 
colored fields are of the forms 



Wd = J2 [^ij 9ig-So + Mij {giD'jN^ + QiD'^^Hao)] , (15) 

where Z — /zFiZFi and detZ = 1. As explained in the previous section, there is no 
hierarchical structure in Z. The mass matrix of down-type colored fields is given by the 
6x6 matrix [1, 2, 3] 

-Q- g ( psZ pnM ^ ^^^^ 
d[ p,M 

in unit of Ms, where ps = {So)/Ms, Pn = {NS)/Ms and pd = {Hdo)/Ms = Vdo/Mg. 
The above mass matrix j\4d is diagonalized via bi-unitary transformation as 

Vd'MdUd = diag(4°\ e,ylf ), (17) 

where = Pd/ Pn = Vdo/{N§) — 0(10"-'^^). To solve the eigenvalue problem, it is conve- 
nient to take M.dM]i and express it as 



a7 A7t I ^d + Bd CdBd \ . . 



where Ad — \ps\^ ZZ^ and Bd — \pn\^ M.-M^ ■ Since is a very small number, we can 
carry out our calculation by using perturbative e^-expansion. Among six eigenvalues 



*An early attempt of explaining the CKM matrix via I?"^ g"^ mixings lias been made in Ref.[12], in 
which a SUSY 50(10) model was taken. 
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three of them represent heavy modes with the GUT scale masses. The remaining three, 
corresponding to down-type quarks, are derived from diagonahzation of the {^d^ + 
B^^)~^, namely 

+ B^Y'Vd = (6.4'¥- (19) 
Down-type quark masses are given by Mse^A^^^ = diag(md, m^, m^). Explicit forms are 



^/a 



(20) 



where 



b = Cdli^i X mih\\ 



c — 



(-2 I— |2 , I — |2 
id Fill + |mii| , 



(21) 
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Here we use the notations Zij = {Z)ij, Zij = A[Z)*- and 

rui = (mij, m2i, ms^)^, mj = (mu, m2i, msj)^. 



Diagonahzation matrix Vd is of the form 

Vd 
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We are now in a position to calculate the CKM mixing matrix [13] as 

VcKM^V-'Vd^VlVd. (23) 



Thus 



More exphcitly, we have [3] 



{VcKMhj = w^,'^*-wf. (24) 



V _ ri/ ^ ~ ^«i-"2 Cd^ii (^ixmi)* 

m*i a 

Vcb = (T^ckm)23 ^ _ 

mss (;zi X mi)^ 

V^d = (V^ckm)2i -(Ks)*, (25) 

T4. = (^CKm)32 ^ -(Kb)*, 

Kd = (K:KM)3i - {VusV,,r, 

3ai-2a2 ^3 (^3 ' WT*) 



Kfc = (VbKM)l3 ^ 2; 



m];i |(zi X mi)3|^ 



All off-diagonal elements of the Vckm contain the F-N factors. This means that there is 
little difference between the diagonalization matrices for up-type quarks and for down- 
type quarks in S'f/(2)L-doublets. Further, Vub is zero in the leading order but non-zero 
in the next-to-leading order, which implies that the element Vub is naturally suppressed 
compared to Vtd- 



4 Charged lepton mass matrix 

Effective Yukawa interactions among charged leptons are described as 



We = J2 [^iijHdiHujSo + Mij {hH^jN^ + hE^H^o)] , (26) 
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where % = fn A-f^A with det H — 1. The matrix H has no hierarchical structure. In the 
lepton sector, mixings occur between L and which are SU (2) ^-doublets. Consequently, 
the charged lepton mass matrix is expressed in terms of the 6x6 matrix [4, 5] 



Ml 



Psn 

PnM PdM 



(27) 



in unit of Ms- The study of the charged lepton mass matrix is parallel to that of the 
down-type quark mass matrix in the previous section. The matrix A4i is diagonalized via 
bi-unitary transformation as 



(28) 



Among six eigenvalues three of them represent heavy modes with the GUT scale masses. 
The remaining three, corresponding to charged leptons, are derived from the diagonaliza- 
tion 

elVr\A-' + BiT'Vi = ie^A^^?, (29) 
where Ai = \ps\'^'H)'H and Bi = Ip^l"^ Ai'^Ai. Charged lepton masses are given by 
MseaAf^ = diag(me, m„ m.). Exphcit forms are 



(me, m^, rrir) ~ v^dfux'^^ x 



fi2 
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Here we use the notations m'ij = A{M)ji = m*^, h[j = h'ij = A{H)ji and 
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5 Neutrino mass matrix 

In the neutral lepton sector we have the 15 x 15 mass matrix [4, 5] 
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where pu — {Huo)/Ms — Vuo/Ms and J\f, S stand for Majorana mass matrices for the 
superfields N'^ and -S" with odd R-parity. This mass matrix comes from the effective 
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Yukawa interactions 



3 3 

Wns = J2nijHaiH^jSo+ Mij {LiH^jN^ + UN^H^o) 

i,j=l i,j=l 
3 

+ ^2 -^^i i^iHujHdo + SiHdjHuo) (35) 

and from Majorana mass terms for N'^ and S. Here we assume (the electroweak scale) <C 
{J\f scale) <C {S scale) . The matrix J\f has the form 

X^fNr2Nr2, 

in which N contains no hierarchical structure and dot = 1. 

Mixings in the lepton sector occur between S'f/(2)L-doublet fields L and Ha- When 
we diagonalize the charged lepton mass matrix, the neutral leptons in S'[/(2)/^-doublet 
undergo the same transformation as the diagonalization matrix for charged leptons. In 
addition, the seesaw mechanism is at work. Hence, neutrino mass matrix for light modes 
becomes 

M, = Msel Vj M-^ V; Af^ (36) 

in the diagonal mass basis for charged leptons, where e„ = Pu/ Pn — Vuo/{Nq) — O{10~^^). 
By diagonalizing M.,^ we obtain neutrino masses 

Vj A^i. V,. = diag(mi,i, rriiy^: ^1^3) (37) 

and the MNS matrix [7] 

Vmns = Vj. (38) 

The matrix Al,^ is rewritten as 

= Y, (39) 

JN 

where 

Y ^ r^^Vi A'fl (40) 
As seen in Eq.(32), Vi is of the form 



/ 1 -alx^^-^^ a;x^' 

aix^^-^^ 1 -alx^^ I . (41) 
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In addition, from Eq.(30) the matrix yl^ is described as 



oc r2 X diag 



la' 



(42) 



Hence, Y = {yi, 2/2, 2/3) is given by 
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where (Tj's (i = 1 ~ 4) are 0{1). We note that in the upper triangular elements of Y the 
F-N factors x^'^ and x'^^ cancel out. Introducing the notation 



= diag 



d Vc' a' 



a' 6'' 6' 



— , 1 = diag(fi;i, ^2, 1) , 



(44) 



we have 



M]si d 



(45) 



with Mat = /at M5, which represents the typical scale of the R-handcd neutrino Majorana 
masses. In the present model the F-N factors x^^^, x^^^'^ and x^^f^^"^"^) are sufficiently 
small compared to 1. Therefore, E is approximated as 
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6 Numerical analysis 



In a simple setting N — 1 and vl^ = 1, the matrix Vmns is nothing but diagonahzation 
matrix of E. Further, when we put ui = (74 = 2.2 and — 1.2 in Eq.(46), the eigenvalues 
of E turn out to be 0.039, 2.122 and 11.959. It follows that the neutrino mass ratio is 



1/2 



5.57 



(47) 



for the normal hierarchy, which is consistent with experimental data: 5.56 ± 0.20. The 
observed absolute value of Aml2 — ttiI^ is obtained by taking Mjv — O(10^)GeV. The 
MNS matrix is estimated as 



0.865 
-0.455 
0.211 



0.471 
0.594 
-0.652 



0.172 \ 
0.663 
0.728 y 



(48) 



Experimental data provided that 5cp — show [10] 



Vmns — 



( 0.824 
-0.499 
^ 0.266 



0.547 
0.583 
-0.601 




(49) 



Although our setting N — 1 and yl^ = 1 is very simple, all elements offered here are 
consistent with the observed values within 20% including | (Vmns) 13 1 = | sin ^13 1. 

Finally we discuss fermion mass spectra and the CKM matrix. The present setting 

— 1 [ki — K2 — 1) means 

me : : m^- = x^^ : x^'^ : 1. (50) 

From experimental values of masses we have x^^ — A^"^ and = A^'^ with A = 0.23. 
As to the other parameters, we set = A^'^, = A^'^ for the F-N factor /\ and 
= A~°-^, = A"^ which leads to 



fz 



Pn 
Ps 



/m A^"^, 



n Pn J, ,2.7 
JH — — Jm A , 
Ps 



(51) 



respectively. In this setting of parameter values, each first term in Eq.(21) for a and c, 
and Eq.(31) for a' and c' is dominant. From Eqs.(13), (20) and (25), we have 



rris Vdo 
v ~ 

'us 5 

mu Vuo 



(52) 
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Table 1: Quark and lepton masses divided by top quark mass (A = 0.23) 



mass ratio 


our result 


observed values 


rric/mt 


\ 3 3 


\3 34 


mu/mt 


\ 7 7 

A 


\ 7 65 
A 


mb/mt 




y.i>4: 


rris/mt 


^5.1 


^5.11 


rrid/mt 


A^-1 


^7.14 


rrir/mt 


^3.1 


^3.12 


mjuit 


^5.0 


^5.04 


me/mt 


^8.7 


^8.67 



which is independent of values of ttj and Pi {i = 1, 2). The observed value of the left hand 
side leads to {vdo/vuo) — 10.5 = A~^'^, which is reverse to the usual solution with large 
tan /3 = Vu/vd- This fact suggests that Higgs fields other than Huo and Hdo develop their 
VEV's. It is expected that there exist rich spectra of Higgs fields beyond those of the 
MSSM at the TeV scale. We take {vdo/vuo) = A~^'^ as an input of the present analysis. 
In the present setting most of fermion mass hierarchies are attributed to the F-N factors. 
In order to reproduce observed mass spectra and the CKM matrix precisely, we adjust 
the other parameters as 

m33 = A° = A-°-3, 

mn = A°■^ = \-'\ h^n = A^ ^ 

\iz, X rn,)s\ = A°■^ Hz^-rn,)] = A°•^ |(m3 • = X'', (53) 

1(7^1 x^03l = A°•^ |(/i'^7^l)| = A'^. 

As seen in Tables 1 and 2, our results are in good agreement with observed values. 
Although there are many parameters, it is noteworthy that these parameters other than 
h'u are 0{1). Note that this parameter h'u stands for the cofactor A{H)ii. 

We may change the above values of the parameters ctj and /3j (i = 1, 2). As another 
setting of the F-N factors A and 1^2, we put 

^ai^^4.6^ ^a,^^2.6^ = A^•^ X^' ^ X' ' . (54) 

In this case the relation 

TTid : rris ■ mb = x"^ : x"'^ : 1 (55) 
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Table 2: Elements of the CKM matrix 



(VcKM)ij 


our result 


observed values 




^1.0 


^1.02 


Kb 


^2.2 


^2.17 


Vtd 


XS.2 


^3.23 


Kb 


X3.9 


^3.87 



holds together with Eq.(50). Further, we take 



/z = ^/MA^•^ /H = ^/MA^■^ (56) 



PS PS 

corresponding to — 6 — A~^"^ and 



mss = A^-^^ Z33 = A-^-^^ 

X mi)3| = • mOI = A^ |(m3 • z^l = A°•^ (57) 

1(7^1 X 7^031 = A°■«^ i(/i'3 -^oi = A-°-^. 

In this choice of the parameter values our results remain the same as given in Tables 1 
and 2. 



7 Summary 

We have studied flavor mixings, especially the MNS matrix, in detail in the SU{6) x 
SU{2)r model, in which the F-N mechanism plays an important role. Due to the F- 
N mechanism both effective Yukawa couplings and R-handcd neutrino Majorana mass 
matrix have hierarchical structure, which is described in terms of the F-N factors. In this 
model the D'^-g^ and L-H^ mixings as well as generation mixings occur and affect both 
fermion mass spectra and flavor mixings. 

In the D'^-g^ mixings, since D'^ and g'^ are both 5'C/(2)i-singlets, the disparity between 
the diagonalization matrices for up- type quarks and down-type quarks in SU (2)i-doublets 
is rather small. Accordingly, Vckm exhibits small mixing. On the other hand, in the L-H^ 
mixings, since L and are both SU (2) ^-doublets, there appears no disparity between the 
diagonalization matrices for charged leptons and neutrinos unless the seesaw mechanism 
does not take place. As a matter of fact, however, the seesaw mechanism is at work 
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and an additional transformation is required to diagonalize the neutrino mass matrix. 
This additional transformation matrix yields nontrivial Vmns- In the present model the 
neutrino mass matrix has characteristic structure as seen in Eqs.(45) and (46). This is 
due to the fact that the F-N factors cancel out in the upper triangular elements of Y. 
As a consequence, there is no hierarchical structure in A^,^ and eventually Vmns exhibits 
large mixing. 

The characteristic structure of fermion spectra is attributed to the hierarchical effective 
Yukawa couphngs due to the F-N mechanism and also to the D'^-g'^ and L-Ha mixings. 
In particular, the difference of mass hierarchies among up-type quarks, down-type quarks 
and charged leptons has its origin in D^-g^ and L-H^ mixings. In the neutrino sector we 
have to incorporate the Majorana mass hierarchy of R-handed neutrinos with the seesaw 
mechanism. Numerical results are consistent with all observed values of fermion masses 
and mixings. The present model provides a unified description of mass spectra and flavor 
mixings. 

In order to determine the F-N factors and the magnitude of /j's {i = M, Z, H, N) 
theoretically, we need an appropriate flavor symmetry and also the flavor charge assign- 
ment to matter fields. In the previous works we made an attempt to find several solutions 
[14, 15]. The detailed study of this issue is the subject of future works. Further, in this 
paper we ignored the phase factors of VEV's for matter fields and assumed Scp — 0. The 
study of the CP-violation will be carried out elsewhere. 
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